Visual method and apparatus for compensating sound information, storage medium and electronic device

ABSTRACT

The present disclosure provides a visual method and apparatus for compensating sound information, a storage medium, and an electronic device, and relates to the field of human-computer interaction technologies. The method includes: detecting a sound in a first preset range of the game scene, and acquiring a type of the sound, and an orientation of the sound source of the sound relative to the virtual object; providing a visual control on the graphical user interface, the visual control including a virtual component associated with the type of the sound; and controlling a pointing direction of the virtual component according to the orientation of the sound source of the sound relative to the virtual object.

CROSS REFERENCE

This application is based upon and claims priority to Chinese PatentApplication No. 201710762298.3, filed on Aug. 30, 2017, the entirecontents thereof are incorporated herein by reference.

TECHNICAL FIELD

The present disclosure relates to the field of human-computerinteraction technologies, and more particularly, to a visual method andapparatus for compensating sound information, a storage medium, and anelectronic device.

BACKGROUND

In a game of conventional terminals (such as PC, or console device), auser may control a virtual object the game scene and make differentkinds of game operation under various environment then the user has toacquire an environment information based on the current position of thevirtual object, such as the type and the location of a sound in acertain area of the game scene. For example, a location of an enemycharacter in the game may be determined by sound variation of footsteps,and for another example, a danger signal may be triggered by gunshotsfrom the other virtual characters (such as enemy characters, or allycharacters) in the game. Therefore, in a conventional PC game, which isgenerally placed at home or a relatively quiet space, the user canquickly determine the environment in which the virtual object is locatedaccording to the sound in the game, and make a fast response. Inaddition, the immersion is not easily interrupted due to the applicationoccasion of the conventional terminal, especially with a good earphoneor sound equipment, which will bring a better gaming experience to theuser.

At present, with the popularization of mobile terminals, games areincreasingly developed on the mobile terminals. However, compared with aconventional terminal, application occasions of the game on the mobileterminal are relatively wider with the characterization of portability.When the mobile terminal is applied in a noisy occasion, it is difficultfor the user to determine the environment in which the virtual objectcontrolled by the user is located through the sound in the game, and theimmersion of game is easily interrupted.

It should be noted that the information disclosed in the abovebackground section is only for enhancement of understanding thebackground of the present disclosure and therefore can include otherinformation that does not form the prior art that is already known tothose of ordinary skills in the art.

SUMMARY

The present disclosure aims at providing a visual method and apparatusfor compensating sound information, a storage medium, and an electronicdevice.

According to an aspect of the present disclosure, there is provided avisual method for compensating sound information, applied to a touchterminal capable of presenting a graphical user interface, the graphicaluser interface at least partially including a game scene, and at leastpart of a virtual object, wherein the method includes:

detecting a sound in a first preset range of the game scene, andacquiring a type of the sound, and an orientation of the sound source ofthe sound relative to the virtual object;

providing a visual control on the graphical user interface, the visualcontrol including a virtual component associated with the type of thesound; and

controlling a pointing direction of the virtual component according tothe orientation of the sound source of the sound relative to the virtualobject.

According to an aspect of the present disclosure, there is provided avisual method for compensating sound information, applied to a touchterminal capable of presenting a graphical user interface, the graphicaluser interface at least partially including a game scene, and at leastpart of a virtual object, wherein the method includes:

detecting a plurality of sounds in a first preset range of the gamescene, and acquiring a type of each of the sounds, and an orientation ofthe sound source of each of the sounds relative to the virtual object;

providing a visual control on the graphical user interface, the visualcontrol including a virtual component associated with a type of a firstsound in the plurality of sounds; and

controlling a pointing direction of the virtual component according tothe orientation of the sound source of the first sound relative to thevirtual object.

According to an aspect of the present disclosure, there is provided avisual method for compensating sound information, applied to a touchterminal capable of presenting a graphical user interface, the graphicaluser interface at least partially including a game scene, and at leastpart of a virtual object, wherein the method includes:

detecting a plurality of sounds in a first preset range of the gamescene, and acquiring a type of each sound, and an orientation of thesound source of each of the sounds relative to the virtual object;

providing a plurality of visual controls on the graphical userinterface, the number of the visual controls being the same as thesounds, wherein the plurality of visual controls are provided inone-to-one correspondence with the plurality of sounds, and each of thevisual controls includes a virtual component associated with the type ofa respective one of the sounds;

controlling a pointing direction of each of the virtual componentsaccording to the orientation of the sound source of a respective one ofthe sounds relative to the virtual object.

According to an aspect of the present disclosure, there is provided acomputer readable storage medium storing a computer program thereon,wherein the computer program is executed by a processor to implement anyof the above-mentioned visual methods for compensating soundinformation.

According to an aspect of the present disclosure, there is provided anelectronic device, including:

a processor; and

a memory for storing executable instructions of the processor;

wherein the processor is configured to execute any one of the forgoingvisual method for compensating sound, information via executing theexecutable instructions.

It should be understood that the foregoing general description and thefollowing detailed description are exemplary and explanatory only, andcannot limit the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

By describing the exemplary embodiments in detail with reference to thedrawings, the above and other features and advantages of the disclosurewill become more apparent. Obviously, the drawings in the followingdescription merely relate to some embodiments of the disclosure, andbased on these drawings, those of ordinary skills in the art may obtainother drawings without going through any creative effort. In thedrawings:

FIG. 1 is a first flow chart of a visual method for compensating soundinformation according to the present disclosure;

FIG. 2 is a schematic diagram of a first preset range and a secondpreset range in an exemplary embodiment of the present disclosure;

FIG. 3 is a second flow chart of a visual method for compensating soundinformation according to the present disclosure;

FIG. 4 is a schematic diagram of displaying one visual control in anexemplary embodiment of the present disclosure;

FIG. 5 is schematic diagram of displaying one visual control in anotherexemplary embodiment of the present disclosure;

FIG. 6 is a third flow chart of a visual method for compensating soundinformation according to the present disclosure;

FIG. 7 is a schematic diagram of displaying three visual controls in anexemplary embodiment of the present disclosure;

FIG. 8 is a schematic diagram of displaying three visual controls inanother exemplary embodiment of the present disclosure;

FIG. 9 is a block diagram of a visual apparatus for compensating soundinformation according to the present disclosure;

FIG. 10 is a module schematic diagram of an electronic device inexemplary embodiment of the present disclosure; and

FIG. 11 is a schematic diagram of a program product in an exemplaryembodiment of the present disclosure.

DETAILED DESCRIPTION

At present, some game developers indicate an orientation of a soundsource of the sound in the game relative to the virtual object bydisplaying an arrow on a graphical user interface, or a volume variationof the sound by displaying a control including a sound waveform on thegraphical user interface.

None of the above manners could simultaneously display all of thefollowings on the graphical user interface the type of the sound, thedistance between the sound and the virtual object or the orientation ofthe sound relative to the virtual object on the interface. Accordingly,the user cannot acquire the type of the sound, the distance between thesound and the virtual object or the orientation of the sound relative tothe virtual object simultaneously in the noisy environment, so that theuser experience of the game is poor.

The example embodiments will be now described more comprehensively withreference to the drawings.

First, the exemplary embodiments disclose a visual method forcompensating sound information, applied to a touch terminal capable ofpresenting a graphical user interface, the graphical user interface atleast partially including a game scene, and at least part of a virtualobject. The touch terminal may be, for example, an electronic devicehaving a touch screen such as a mobile phone, a tablet computer, alaptop computer, a game machine, or a PDA. A game application may beexecuted on the touch terminal, through an application program interfaceof the touch terminal, a graphical user interface (GUI) is rendered onthe touch screen, so as to display a virtual object and a virtualjoystick area including a virtual joystick, a virtual battle scene, avirtual natural environment, etc. The GUI may either be occupied anentire area of the touch screen or just a partial area, which is notspecifically limited in the exemplary embodiments. The virtual objectrefers to a game character controlled by the user, and is displayed onthe GUI with a partial or overall form of the game character. Forexample, in a first person perspective, the content of GUI is displayedby a master perspective of the user, which enhances the immersiveexperience of the user, and only a part of the game character, such as ahand or a foot, may be shown on the GUI; while in a third-personperspective, the game character may be presented in the GUI as a whole,which reduces the difficulty of game manipulation and dizziness of theuser, and emphasizes the sense of movement in the game. The developermay determine the specific display manner according to the gamecontents, which will not be limited in the present disclosure. As shownin FIG. 1, the visual method for compensating sound information mayinclude the following steps.

In step S1, a sound in a first preset range of the game scene isdetected, and type of the sound and an orientation of a sound source ofthe sound relative to the virtual object are acquired.

In step S2, a visual control is provided on the graphical userinterface, the visual control including a virtual component associatedwith the type of the sound.

In step S3, a pointing direction of the virtual component is controlledaccording to the orientation of the sound source of the sound relativeto the virtual object.

According to the visual method for compensating sound information in theexemplary embodiments, on one hand, a method of simultaneouslydisplaying the type of the sound and the orientation of the sound sourceof the sound relative to the virtual object is provided by the virtualcomponent associated with the type of the sound, the display form of thevirtual component, and the pointing direction of the virtual component,such that the user can identify the type of the sound, and theorientation of the sound source of the sound relative to the virtualobject in a noisy environment by means of the virtual componentassociated with the type of the sound, the display form of the virtualcomponent, and the pointing direction of the virtual component, on theother hand, since the user can simultaneously recognize the type of thesound and the orientation of the sound source of the sound relative tothe virtual object through the above manner, the user experience isbetter than that of the related art.

Hereinafter, the visual display method for compensating soundinformation in the exemplary embodiment will be further described withreference to FIG. 1.

In step S1, the sound in the first preset range of the game scene isdetected, and the type of the sound and the orientation of the soundsource of the sound relative to the virtual object are acquired.

In the present exemplary embodiment, the size of the first preset rangemay be set by a developer according to game contents. For instance, thefirst preset range may be a range determined according to an auditoryrange of a virtual object, and may also be an entire area of the gamescene, or an area of the game scene currently displayed on the GUI.

The sound in the first preset range may be detected by a detectionmodule at a preset period, and the preset period may be set by thedeveloper. However, in order to ensure the accuracy of sound detection,it is unallowable to set the preset period to be too long.

The type of the sound may be acquired by a sound type acquisitionmodule. The type of the sound may be the sound of a footstep, aconversation, a door opening, a gunshot, and a fighting, etc., which isnot specifically limited in the present exemplary embodiment.

Coordinates of the virtual object and coordinates of the sound source ofthe sound may be acquired, and the orientation of the sound source ofthe sound relative to the virtual object may be calculated according tothe coordinates of the virtual object and the coordinates of the soundsource of the sound.

In step S2, a visual control is provided on the graphical userinterface, the visual control including the virtual component associatedwith the type of the sound.

In the present exemplary embodiment, the visual control may be arrangedat any position on the GUI. For example, the visual control may bearranged at an upper left of the GUI; and for another example, thevisual control may be arranged at a lower right of the GUI, which is notspecifically limited in the present exemplary embodiment. A shape of thevisual control may be a circle, a square, an ellipse, or the like. Acolor of the visual control may be set as green, dark, grey, or thelike.

The virtual component may include an ideographic image and a directionidentifier. The ideographic image is used to display the type of thesound, therefore, the ideographic image is consistent with the type ofthe sound. To make the user quickly recognize the type of the soundbased on the ideographic image, the ideographic image may becorresponding to the type of the sound. For example, when there is afootstep in such game scene, the ideographic image may be shown as ashape of feet or an icon of a costumed shoe. For another example, whenthe type of the sound is a gunshot, the ideographic image may be shownas a shape of a gun or a bullet. A color of the ideographic image may beset by the developer, and may also be distinguished according to varioustypes of the sounds. For example, when the type of the sound is agunshot, the color of the ideographic image may be set according to acolor of the gun. For another example, when the type of the sound is afootstep, the color of the ideographic image may be set as black. Itshould be noted that the color of the ideographic image and the color ofthe visual control cannot be set to be too close to each other;otherwise the user cannot quickly recognize the ideographic image.

The direction identifier is used to indicate an orientation of the soundsource of the sound relative to the virtual object, and therefore, apointing direction of the direction identifier is consistent with theorientation of the sound source of the sound relative to the virtualobject. The direction identifier may be an arrow or a triangle, and mayalso be an identifier having a pointing direction, such as a pointer,which is not specifically limited in this exemplary embodiment. A colorof the direction identifier may be set by the developer, for example,may be green, or red. The pointing direction of the direction identifiermay be changed continuously in 360 degree following the change oforientation of the sound source of the sound relative to the virtualobject, i.e., when the sound source of the sound changes continuouslyrelative to the orientation of the virtual object, the pointingdirection of the direction identifier is also changed continuously.

In step S3, the pointing direction of the virtual component iscontrolled according to the orientation of the sound source of the soundrelative to the virtual object.

In the present exemplary embodiment, when the virtual component includesthe ideographic image and the direction identifier, the pointingdirection of the direction identifier in the virtual component may becontrolled according to the orientation of the sound source of the soundrelative to the virtual object.

In the present exemplary embodiment, the direction identifier may bearranged at any fixed position surrounding the visual control. Based onthis, the direction identifier may be rotated as a center of any pointon the direction identifier to change the pointing direction of thedirection indicator.

In the present exemplary embodiment, the direction identifier may alsobe arranged on a boundary of the visual control or arranged around thevisual control. Based on this, the direction identifier may be movedalong a preset track to change the pointing direction of the directionidentifier, wherein the preset track may be, for example, the boundaryof the visual control.

In an embodiment, the visual method for compensating sound informationmay further include: acquiring a distance between the sound source ofthe sound and the virtual object; and controlling a display form of thevirtual component according to the distance between the sound source ofthe sound and the virtual object.

In an embodiment, the controlling the display form of the virtualcomponent according to the distance between the sound source of thesound and the virtual object may include: controlling a display form ofat least one of a transparency, a size, and a brightness of the virtualcomponent according to the distance between the sound source of thesound and the virtual object.

In the present exemplary embodiment the controlling the display form ofthe virtual component according to the distance between die sound sourceof the sound and the virtual object may include following manners.

In a first manner, a display form, such as a transparency of the virtualcomponents is controlled according to the distance between the soundsource of the sound and the virtual object.

In the present exemplary embodiment, the transparency of the virtualcomponent is inversely related to the distance between the sound sourceof the sound and the virtual object, i.e., the further the distancebetween the sound source of the sound and the virtual object is, thehigher the transparency of the virtual component is; and the closer thedistance between the sound source of the sound and the virtual objectis, the lower the transparency of the virtual component is. It should benoted that the transparency of the virtual component is in the rangefrom 100% to 0%, wherein the virtual component is completely transparentwhen the transparency of the virtual component is 100%, and the virtualcomponent is completely opaque when the transparency of the virtualcomponent is 0%.

In a second manner, a display form, such as a size of the virtualcomponent is controlled according to the distance between the soundsource of the sound and the virtual object.

In the present exemplary embodiment, the size of the virtual componentis inversely related to the distance between the sound source of thesound and the virtual object. In other words, the further the distancebetween the sound source of the sound and the virtual object is, thesmaller the size of the virtual component is; and the closer thedistance between the sound source of the sound and the virtual objectis, the larger the size of the virtual component is.

In a third manner, a display form, such as a brightness of the virtualcomponent is controlled according to the distance between the soundsource of the sound and the virtual object.

In the present exemplary embodiment, the brightness of the virtualcomponent is inversely related to the distance between the sound sourceof the sound and the virtual object, i.e., the further the distancebetween the sound source of the sound and the virtual object is, thelower the brightness of virtual component is; and the closer diedistance between the sound source of the sound and the virtual objectis, the higher the brightness of the virtual component is.

It should be noted that the display forms of at least two or three ofthe transparency, the size and the brightness of the virtual componentmay also be controlled according to the distance between the soundsource of the sound and the virtual object.

Moreover, when the virtual component includes the ideographic image andthe direction identifier, the controlling the display form of thevirtual component according to the distance between the sound source ofthe sound and the virtual object includes: controlling a display form ofthe ideographic image and/or the direction Identifier in the virtualcomponent according to the distance between the sound source of thesound and the virtual object.

In the present exemplary embodiment, the distance between the soundsource of the sound and the virtual object may be displayed bysimultaneously controlling the display forms of the ideographic imageand the direction identifier, or the distance between the sound sourceof the sound and the virtual object may be displayed by controlling thedisplay form of one of the ideographic image and the directionidentifier.

Further, a display form of a transparency of the ideographic imageand/or the direction identifier in the virtual component may becontrolled according to the distance between the sound source of thesound and the virtual object; or a display form of a size of theideographic image and/or the direction identifier in the virtualcomponent may be controlled according to the distance between the soundsource of the sound and the virtual object; or a display form of abrightness of the ideographic image and/or the direction identifier inthe virtual component may be controlled according to the distancebetween the sound source of the sound and the virtual object.

It should be noted that, any two or three display forms among thetransparency, the size, or the brightness of the ideographic imageand/or the direction identifier in the virtual component may also becontrolled according to the distance between the sound source of thesound and the virtual object.

In conclusion, a method of simultaneously displaying the type of thesound, and the orientation of the sound source of the sound relative tothe virtual object is provided by the virtual component associated withthe type of the sound, the display form of the virtual component, andthe pointing direction of the virtual component, such that the user canidentity the type of the sound, and the orientation of the sound sourceof the sound relative to the virtual object in a noisy environment bymeans of the virtual component associated with the type of the sound,the display form of the virtual component, and the pointing direction ofthe virtual component. Moreover, since the user can simultaneouslyrecognize the type of the sound, the orientation of the sound source ofthe sound relative to the virtual object through the above manner, theuser experience is better than that of the related art.

In addition, before providing the visual control on the graphical userinterface, the method may further include: determining the sound sourceof the sound is located within a second preset range and out of a thirdpreset range.

In the present exemplary embodiment, the second preset range is a rangewhich the virtual object may be affected therein, and the second presetrange is a range centered on the virtual object. For example, as shownin FIG. 2, the second preset range A may be a circular area centered onthe virtual object 1. In addition, the second preset range may also beas a shape of a square or an elliptical centered on the virtual objectwhich is not specifically limited in the present exemplary embodiment.The third preset range is a range in which a visual field of the virtualobject is clear. As shown in FIG. 2, the third preset range B may be asector-shaped region with the virtual object 1 as a reference point, andan area of the sector-shaped region is set according to the clear rangeof the visual field of the virtual object. For example, in anenvironment of game scene with a smooth terrain and rare obstacles, thearea of the sector-shaped region may be set relatively larger. Foranother example, in an environment of game scene with the uneven terrainand many obstacles, the area of the sector-shaped region may be an areaof the sector-shaped region after subtracting the parts of the obstaclesor the uneven terrain.

When a position of the sound source of the sound is acquired, it isdetermined whether a positron coordinate of the sound source of thesound is located within the second preset range and out of the thirdpreset range; when it is determined that the position coordinate of thesound source of the sound is located within the second preset range andout of the third preset range, the visual control is displayed on thegraphical user interface; and when it is determined that the positioncoordinate of the sound source of the sound is out of the second presetrange or within the third preset range, the visual control is notdisplayed on the graphical user interface.

Through the above manners, when the position of the sound source of thesound is far away from the virtual object, the sound may not affect thevirtual object in a short time. For example, a gunshot sound far awayfrom the virtual object does not pose a threat to the virtual object ina short time, therefore, by setting the second preset range (i.e., arange which the virtual object may be affected therein), and displayingthe visual control only when the position of the sound source of thesound is located within the second preset range. Accordingly, a displaylogic is optimized and redundant design of the visual control issimplified. Moreover, when the position of the sound source of the soundis located within the third preset range (i.e., the position of thesound source of the sound is located within a clear visual range of thevirtual object, wherein the virtual object controlled by the user mayclearly capture the virtual source, such as non-player character, enemycharacter, virtual building, or the like, in such clear visual range ofthe game scene), the user can clearly obtain the position of the soundsource of the sound. Therefore, the visual control is not displayed onthe graphical user interface, and the visual control is only displayedwhen the position of the sound source of the sound is out of the thirdpreset range (i.e., the position of the sound source of the sound is outof the visual clear range of the virtual object), so that the displaylogic is further optimized and the redundant design of the visualcontrol is simplified.

The exemplary embodiments of the present disclosure further disclose avisual method for compensating sound information, applied to a touchterminal capable of presenting a graphical user interface, the graphicaluser interface at least partially including a game scene, and at leastpart of a virtual object. The touch terminal may be, for example, anelectronic device having a touch screen such as a mobile phone, a tabletcomputer, a laptop computer, a game machine, or a PDA. A gameapplication may be executed on the touch terminal, through anapplication program interface of the touch terminal, a graphical userinterface (GUI) is rendered on the touch screen, so as to display avirtual object and a virtual joystick area including a virtual joystick,a virtual battle scene, a virtual natural environment, etc. The GUI mayeither be occupied an entire area of the touch screen or just a partialarea, which is not specifically limited in the exemplary embodiments.The virtual object refers to a game character controlled by the user,and is displayed on the GUI with a partial or overall form of the gamecharacter. For example, in a first person perspective, the content ofGUI is displayed by a master perspective of the user, which enhances theimmersive experience of the user and only a part of the game character,such as a hand or a foot, may be shown on the GUI; while in athird-person perspective, the game character may be presented in the GUIas a whole, which reduces the difficulty of game manipulation anddizziness of the user, and emphasizes the sense of movement m the game.The developer may determine the specific display manner according to thegame contents, which will not be limited in the present disclosure. Asshown in FIG. 3, the visual display method for compensating soundinformation may include the following steps.

In S10, a plurality of sounds in a first preset range in the game sceneare detected, and a type of each of the sounds and an orientation of asound source of each of the sounds relative to the virtual object areacquired.

In the present exemplary embodiment, a size of the first preset rangemay be set by a developer according to game contents. For instance, thefirst preset range may be a range determined according to an auditoryrange of a virtual object, and may also be an entire area of the gamescene, or an area of the game scene currently displayed on the GUI, orthe like.

The plurality of sounds in the game scene may be detected by a detectionmodule at a preset period, and the preset period may be set by thedeveloper but to ensure the accuracy of sound detection, the presetperiod cannot be too long.

The types of the plurality of sounds may be respectively acquired by asound type acquisition module. The type of the sound may be the sound ofa footstep, a conversation, a door opening, a gunshot, and a fighting,etc., which is not specifically limited in the present exemplaryembodiment.

It is possible to acquire coordinates of the sound source of each soundand coordinates of the virtual object, and then calculate the distancebetween the sound source of the sound and the virtual object or theorientation of the sound source of each sound relative to the virtualobject according to the coordinates of the sound source of each soundand the coordinates of the virtual object.

The plurality of sounds may be three, or four, or five, which is notspecifically limited in the exemplary embodiments. The types of theplurality of sounds may be completely identical, or completelydifferent, or may not be completely identical.

In step S20, a visual control is provided on the graphical userinterface, the visual control including a virtual component associatedwith a type of a first sound in the plurality of sounds.

In the present exemplary embodiment, a position of the visual controlmay be any position on the graphical user interface, for example, may beat the lower right of the graphical user interface, or may be at theupper left of the graphical user interface, which is specificallylimited in the exemplary embodiments.

The plurality of sounds may be sequentially sorted in a preset manner,and a sound ranked first is determined as the first sound. The presetmanner may be that the sounds are sorted according to the distancesbetween the sound sources of the sounds and the virtual object from thenear to the distant, in this way, the sound closest to the virtualobject is ranked as the first, and the virtual object farthest to thevirtual object is ranked as the last. The preset manner may also be thatthe sounds are sorted according to threat levels of the sounds to thevirtual object in a descending order, in this way, the sound having ahighest threat level to the virtual object is ranked as the first, andthe virtual object having a lowest threat level to the virtual object isranked as the last. It should be noted that the preset manner in theexemplary embodiment is not limited thereto.

In the present exemplary embodiment, the virtual component may includean ideographic image and a direction identifier, the ideographic imageis corresponding to the type of the first sound, and a pointingdirection of the direction identifier is consistent with the orientationof the sound source of the first sound relative to the virtual object.The ideographic image and the direction identifier in the virtualcomponent described above may enable the user to acquire the type of thefirst sound and the orientation of the sound source of the first soundrelative to the virtual object.

The virtual component may further include an ideographic image andplurality of direction identifiers, the number of the plurality ofdirection identifiers being the same as that of the plurality of sounds.The ideographic image is corresponding to the type of the first sound,and the plurality of direction identifiers are in one-to-onecorrespondence with the plurality of sounds. That is, one directionidentifier corresponds to one sound, and one sound corresponds to onedirection identifier. By the ideographic image in the virtual componentand the plurality of direction identifiers with a number same as that ofthe plurality of sounds, the user can acquire the type of the firstsound and the orientation of the sound source of each sound relative tothe virtual object. Based on this, to make the user quickly distinguishthe orientation of the sound source of the first sound relative to thevirtual object from the plurality of direction identifiers, thedirection identifier indicating the orientation of the sound source ofthe first sound relative to the virtual object and the directionindicator indicating the orientations of the sound sources of othersounds relative to the virtual object may be displayed distinctively.

It should be noted that, since the ideographic image and the directionidentifier have been described in detail in the visual method forcompensating sound information described in FIG. 1 above, details willnot be elaborated herein.

In step S30, a pointing direction of the virtual component is controlledaccording to an orientation of the sound source of the first soundrelative to the virtual object.

In the present exemplary embodiment, the virtual component may includean ideographic image and a direction identifier. In this case, bycontrolling the pointing direction of the direction identifier in thevirtual component according to the orientation of the sound source ofthe first sound relative to the virtual object, the user can acquire theorientation of the sound source of the first sound relative to thevirtual object according to the direction identifier.

Also, the virtual component may include an ideographic image and aplurality of direction identifiers, a number of the plurality ofdirection identifiers being the same as that of the plurality of sounds,wherein the ideographic image is corresponding to the type of the firstsound, and the plurality of direction identifiers are in one-to-onecorrespondence with the plurality of sounds. In this case, according tothe orientation of the sound source of each of the sounds relative tothe virtual object, the pointing direction of each of the correspondingdirection identifiers may be controlled, i.e., one direction identifiercorresponds to the orientation of the sound source of one sound relativeto the virtual object. Through the above-mentioned manners, the user canacquire the orientation of the sound source of each sound relative tothe virtual object according to the pointing direction of each directionidentifier.

In an embodiment, the visual method for compensating sound informationmay further include: acquiring a distance between the sound source ofthe first sound and the virtual object; and controlling a display formof the virtual component according to the distance between the soundsource of the first sound and the virtual object.

In the present exemplary embodiment, a display form of a transparency ofthe virtual component may be controlled according to the distancebetween the sound source of the first sound and the virtual object,wherein the further the distance is, the higher the transparency is, andthe closer the distance is, the lower the transparency is. A displayform of a size of the virtual component may be controlled according tothe distance between the sound source of the first sound and the virtualobject, wherein the further the distance is, the smaller the virtualcomponent is; and the closer the distance is, the larger the virtualcomponent is. A display form of a brightness of the virtual componentmay also be controlled according to the distance between the soundsource of the first sound and the virtual object, wherein the furtherthe distance is, the lower the brightness is, and the closer thedistance is, the higher the brightness is. By controlling the displayform of the virtual component according to the distance between thesound source of the first sound and the virtual object, the user canacquire the distance between the sound source of the first sound and thevirtual object according to the display form of the virtual component.

When the virtual component includes an ideographic image and a directionidentifier, a display form of the ideographic image and/or the directionidentifier may be controlled according to the distance between the soundsource of the first sound and the virtual object. To be specific, adisplay form of a transparency of the ideographic image and/or thedirection identifier may be controlled according to the distance betweenthe sound source of the first sound and the virtual object. A displayform of a size of the ideographic image and/or the direction identifiermay also be controlled according to the distance between the soundsource of the first sound and the virtual object. It may be known fromthe above that the user may acquire the distance between the soundsource of the first sound and the virtual object by the display form ofthe ideographic image and/or the direction identifier.

When the virtual component includes an ideographic image and a pluralityof direction identifiers having a number same as that of the pluralityof sounds, a display form of the ideographic image and/or the directionindicator corresponding to the first sound may be controlled accordingto the distance between the sound source of the first sound and thevirtual object. To be specific, a display form of a transparency of theideographic image and/or the direction identifier corresponding to thefirst sound may be controlled according to the distance between thesound source of the first sound and the virtual object. A display formof a size of the ideographic image and/or the direction identifiercorresponding to the first sound may also be controlled according to thedistance between the sound source of the first sound and the virtualobject. It may be known from the above that the user may acquire thedistance between the sound source of the first sound and the virtualobject by the display form of the ideographic image and/or the directionidentifier corresponding to the first sound.

Moreover, when the virtual component includes an ideographic image and aplurality of direction identifiers having a number same as that of theplurality of sounds, a display form of the direction indicatorassociated with a respective one of the sounds may be controlledaccording to the distance between the sound source of the respective oneof the sounds and the virtual object. To be specific, the display formof the transparency of the direction indicator associated with arespective one of the sounds may be controlled according to the distancebetween the sound source of the respective one of the sounds and thevirtual object, or the display form of the size of the directionindicator associated with a respective one of the sounds may becontrolled according to the distance between the sound source of therespective one of the sounds and the virtual object. It may be knownfrom the above that the user can respectively acquire the distancesbetween the sound sources of individual sounds and the virtual object bythe display forms of the direction identifiers corresponding toindividual sounds.

The above process will be described hereinafter by taking the number ofthe plurality of sounds is three as an example.

For example, the above three sounds are respectively a first sound, asecond sound, and a third sound, wherein types of the first to thirdsounds are sound of a footstep, a gunshot, and a door openingrespectively, distances between sound sources of the first to thirdsounds and the virtual objects are 10 m, 20 m, and 30 m respectively,and orientations of the sound sources of the first to third soundsrelative to the virtual object are front, back and left respectively.Based on this, the first to third sounds are sorted in a manner from thenear to the distant according to the distance between the sound sourceof the sound and the virtual object. It can be seen that the first soundis ranked in the first. As shown in FIG. 4, the visual control 2 in thefigure includes a virtual component. The virtual component includes oneideographic image 20 and three direction identifiers, wherein a shape ofthe ideographic image 20 is consistent with the type of the first sound,i.e., a shape of feet or an icon of a costumed shoe. The three directionindicators are a first direction indicator 21, a second directionindicator 22, and a third direction indicator 23 respectively. The firstdirection indicator 21 indicates an orientation of a sound source of thefirst sound relative to the virtual object, so that, a direction of thefirst direction indicator points to the front. The second directionindicator 22 indicates an orientation of a sound source of the secondsound relative to the virtual object, so that, a direction of the seconddirection indicator points to the back. The third direction indicator 23indicates an orientation of a sound source of the third sound relativeto the virtual object, so that, a direction of the third directionindicator points to the left. In FIG. 4, sizes of the first to thirddirection identifiers are respectively controlled according to thedistances between the sound sources of the first to third sounds and thevirtual object, wherein the further the distance is, the smaller thedirection identifier is; and the closer the distance is, the larger thedirection identifier is. Therefore, the size of the first directionidentifier 21 is larger than the size of the second direction identifier22, and the size of the second direction identifier 22 is larger thanthe Size of the third direction identifier 23. It should be noted that,in FIG. 4, the first direction identifier 21 is filled with a colonwhile the second direction identifier 22 and the third directionidentifier 23 are not filled with color, so that the user coulddistinguish the first direction identifier 21 as the directionidentifier corresponding to the first sound according to the color.

For another example, the above three sounds are respectively a firstsound, a second sound, and a third sound, wherein types of the first tothird sounds are all the sound of footstep, distances between soundsources of the first to third sounds and the virtual objects are 10 m,20 m, and 30 m respectively, and orientations of the sound sources ofthe first to third sounds relative to the virtual object are front, backand left respectively. Based on this, the first to third sounds aresorted in a manner from the near to the distant according to thedistance between the sound source of the sound and the virtual object.It can be seen that the first sound is ranked in the first. As shown inFIG. 5, the visual control 2 in the figure includes a virtual component.The virtual component includes one ideographic image 20 and threedirection identifiers, wherein a shape of the ideographic image 20 isconsistent with the type of the first sound, i.e., a shape of a gun or abullet. The three direction indicators are a first direction indicator21, a second direction indicator 22, and a third direction indicator 23respectively. The first direction indicator 21 indicates an orientationof a sound source of the first sound relative to the virtual object, sothat, a direction of the first direction indicator points to the front.The second direction indicator 22 indicates an orientation of a soundsource of the second sound relative to the virtual object, so that adirection of the second direction indicator points to the back. Thethird direction indicator 23 indicates an orientation of a sound sourceof the third sound relative to the virtual object, so that, a directionof the third direction indicator points to the left. In FIG. 5, sizes ofthe first to third direction identifiers are respectively controlledaccording to the distances between the sound sources of the first tothird sounds and the virtual object, wherein the further the distanceis, the smaller the direction identifier is; and the closer the distanceis, the larger the direction identifier is. Therefore, the size of thefirst direction identifier 21 is larger than the size of the seconddirection identifier 22, and the size of the second direction identifier22 is larger than the size of the third direction identifier 23. Itshould be noted that, in FIG. 5, the first direction identifier 21 isfilled with a color, while the second direction identifier 22 and thethird direction identifier 23 are not filled with colors, so that theuser could distinguish the first direction identifier 21 as thedirection identifier corresponding to the first sound according to thecolor.

In conclusion, when a plurality of sounds In the game scene are detectedin the, the type of the first sound in the plurality of sounds, and theorientation of the sound source of the first sound relative to thevirtual object are displayed by the virtual component associated withthe type of the first sound in the plurality of sounds, the display formof the virtual component, and the pointing direction of the virtualcomponent, such that the user can identify the type of the first sound,and the orientation of the sound source of the first sound relative tothe virtual object in a noisy environment by means of the virtualcomponent associated with the type of the first sound, the display formof the virtual component, and the pointing direction of the virtualcomponent.

Alternatively, when a plurality of sounds in the game scene aredetected, the type of the first sound in the plurality of sounds, andthe orientations of the sound sources of the plurality of soundsrelative to the virtual object are displayed by the virtual componentassociated with the type of the first sound in the plurality of sounds,the pointing directions of the plurality of direction identifiers havinga number same as that of the plurality of sounds m the virtualcomponent, and the display forms of the plurality of directionidentifiers having a number same as that of the plurality of sounds inthe virtual component, such that the user can identify the type of thefirst sound, and the orientations of the sound sources of the pluralityof sounds relative to the virtual object in a noisy environment by meansof the virtual component associated with the type of the first sound,the pointing directions of the plurality of direction identifiers havinga number same as that of the plurality of sounds in the virtualcomponent, and the display forms of the plurality of directionidentifiers having a number same as that of the plurality of sounds inthe virtual component.

The exemplary embodiments of the present disclosure further disclose avisual method for compensating sound information, applied to a touchterminal capable of presenting a graphical user interface, the graphicaluser interlace at least partially including a game scene, and at leastpart of a virtual object. The touch terminal may be, for example, anelectronic device having a touch screen such as a mobile phone, a tabletcomputer, a laptop computer, a game machine, or a PDA. A gameapplication may be executed on the touch terminal, through anapplication program interface of the touch terminal, a graphical userinterface (GUI) is rendered on the touch screen, so as to display avirtual object and a virtual joystick area including a virtual joystick,a virtual battle scene, a virtual natural environment, etc. The GUI mayeither be occupied an entire area of the touch screen or just a partialarea, which is not specifically limited in the exemplary embodiments.The virtual object refers to a game character controlled by the user,and is displayed on the GUI with a partial or overall form of the gamecharacter. For example, in a first person perspective, the content ofGUI is displayed by a master perspective of the user, which enhances theimmersive experience of the user, and only a part of the game character;such as a band or a toot, may be shown on the GUT, while in athird-person perspective, the game character may be presented in the GUIas a whole, which reduces the difficulty of game manipulation anddizziness of the user, and emphasizes the sense of movement in the game.The developer may determine the specific display manner according to thegame contents, which will not be limited in the present disclosure. Asshown in FIG. 6, the visual method for compensating sound informationmay include the following steps.

In S100, a plurality of sounds in a first preset range of the game sceneare detected, and a type of each of the sounds and an orientation of asound source of each of the sounds relative to the virtual object areacquired.

In the exemplary embodiment, since the above steps have been describedin detail in step S10 of the visual method tor compensating soundinformation described in FIG. 3, details will not be elaborated herein.

In step S200, a plurality of visual controls are provided on thegraphical user interface, a number of the plurality of visual controlsbeing the same as that of the plurality of sounds, wherein the pluralityof visual controls are in one-to-one correspondence with the pluralityof sounds, and each of the visual controls includes a virtual componentassociated with the type of a respective one of the sounds.

In the exemplary embodiment, the number of the visual controls is thesame as the number of the sounds, one sound corresponds to one visualcontrol only, and one visual control also corresponds to one sound only.

Each of the virtual components may include an ideographic image and adirection identifier. The ideographic image in the virtual component isconsistent with the type of the sound associated with the virtualcomponent, and the direction identifier in the virtual component isconsistent with an orientation of the sound source of the soundassociated with the virtual component relative to the virtual object.

It should be noted that, since the ideographic image and the directionidentifier have been relationally described in detail in the visualmethod for compensating sound information described in FIG. 1 above,details will not be elaborated herein.

In step S300, a pointing direction of each of the virtual components iscontrolled according to the orientation of the sound source of arespective one of the sounds relative to the virtual object.

In the exemplary embodiment, when the virtual component includes anideographic image and a direction identifier, and a pointing directionof the direction indicator in each of the virtual components may becontrolled according to the orientation of the sound source of arespective one of the sounds relative to the virtual object.

In an embodiment, the visual method for compensating sound informationmay further include: acquiring a distance between a sound source of arespective one of the sounds and the virtual object; and controlling adisplay form of each of the virtual components according to the distancebetween the sound source of a respective one of the sounds and thevirtual object.

In the exemplary embodiment, a display form of a transparency of each ofthe virtual components may be controlled according to the distancebetween the sound source of a respective one of the sounds and thevirtual object. A display form of a size of each of the virtualcomponents may also be controlled according to the distance between thesound source of a respective one of the sounds and the virtual object.

When each of the virtual components includes an ideographic image and adirection identifier, the controlling the display form of each of thevirtual components according to the distance between sound source of arespective one of the sounds and the virtual object may include:controlling a display form of a size of the ideographic image and/or thedirection identifier in each of the virtual components according to thedistance between the sound source of a respective one of the sounds andthe virtual object. To be specific, a display form of the transparencyof the ideographic image and/or the direction indicator in each of thevirtual components may be controlled according to the distance betweenthe sound source of a respective one of the sounds and the virtualobject, or a display form of a size of the ideographic image and/or thedirection indicator in each of the virtual components may be controlledaccording to the distance between the sound source of a respective oneof the sounds and the virtual object.

The above process will be described hereinafter by taking the pluralityof sounds as three sounds for example.

For example, the above three sounds are respectively a first sound, asecond sound, and a third sound, wherein types of the first to thirdsounds are sound of a footstep, a gunshot, and a door openingrespectively, distances between sound sources of the first to thirdsounds and the virtual objects are 10 m, 20 m, and 30 m respectively,and orientations of the sound sources of the first to third soundsrelative to the virtual object are front, back and left respectively. Asshown in FIG. 7, there are three visual controls, which are respectivelya first visual control 3, a second visual control 4, and a third visualcontrol 5. The first visual control 3 includes a first virtual componentassociated with a type of the first sound, the second visual control 4includes a second virtual component associated with a type of the secondsound, and the third visual control 5 includes a third virtual componentassociated a type of the third sound. The first virtual componentincludes a first ideographic image 30 associated with the type of thefirst sound, and a first direction identifier 31 consistent with anorientation of a sound source of the first sound relative to die virtualobject, wherein the first ideographic image 30 is in a shape of feet oran icon of a costumed shoe, and the first direction indicator 31 pointsto the front. The second virtual component includes a second ideographicimage 40 associated with the type of the second sound and a seconddirection identifier 41 consistent with an orientation of a sound sourceof the second sound relative to the virtual object, wherein the secondideographic image 40 is in a shape of a gun or a bullet, and the seconddirection identifier 41 points to the back. The third virtual componentincludes a third ideographic image 50 associated with the type of thethird, sound, and a third direction identifier 51 consistent with anorientation of a sound source of the third sound relative to the virtualobject, wherein the third ideographic image 50 is in a shape of doors,and the third direction indicator 51 points to the left. The distancesbetween the sound sources of the first to third sounds and the virtualobject are displayed by the sizes of the first to third directionidentifiers in FIG. 7. Therefore, the size of the first directionidentifier 31 is larger than the size of the second direction identifier41, and the size of the second direction indicator 41 is larger than thesize of the third direction indicator 51.

For another example, the above three sounds are respectively a firstsound, a second sound, and a third sound, wherein types of the first tothird sounds are all footstep sounds, distances between sound sources ofthe first to third sounds and the virtual objects are 10 m, 20 m, and 30m respectively, and orientations of the sound sources of the first tothird sounds relative to the virtual object are front, back and leftrespectively. As shown in FIG. 8, there are three visual controls, whichare respectively a first visual control 3, a second visual control 4,and a third visual control 5. The first visual control 3 includes afirst virtual component associated with a type of the first sound, thesecond visual control 4 includes a second virtual component associatedwith a type of the second sound, and the third visual control 5 includesa third virtual component associated a type of the third sound. Thefirst virtual component includes a first ideographic image 30 associatedwith the type of the first sound and a first direction identifier 31consistent with an orientation of a sound source of the first soundrelative to the virtual object, wherein the first ideographic image 30is in a shape of feet or an icon of a costumed shoe, and the firstdirection indicator 31 points to the front. The second virtual componentincludes a second ideographic image 40 associated with the type of thesecond sound and a second direction identifier 41 consistent with anorientation of a sound source of the second sound relative to thevirtual object, wherein the second ideographic image 40 is in a shape offeet or an icon of a costumed shoe, and the second direction identifier41 points to the back. The third virtual component includes a thirdideographic image 50 associated with the type of the third sound and athird direction identifier 51 consistent with an orientation of a soundsource of the third sound relative to the virtual object, wherein thethird ideographic image 50 is in a shape of feet or an icon of acostumed shoe, and the third direction indicator 51 points to the left.The distances between the sound sources of the first to third sounds andthe virtual object are displayed by the sizes of the first to thirddirection identifiers in FIG. 8. Therefore, the size of the firstdirection identifier 31 is larger than the size of the second directionidentifier 41, and the size of the second direction indicator 41 islarger than the size of the third direction indicator 51.

In conclusion, in the case that plurality of sounds are detected, bydisplaying the visual controls having a number same as that of theplurality of sounds, and according to the virtual components associatedwith the types of the respective one of the sounds in the visualcontrol, the display forms of the virtual components and the pointingdirections of the virtual components, the user can acquire the type ofeach sound, and the distance or the orientation of the sound source ofeach sound relative to the virtual object according to the virtualcomponents associated with the types of the respective one of the soundsin the visual control, the display forms of the virtual components andthe pointing directions of the virtual components.

It should be noted that although the respective steps of the method ofthe present disclosure are described in a particular sequence in thedrawings, this does not require or imply that these steps must beperformed in the particular sequence or that all of the illustratedsteps have to be performed in order to achieve the expected results.Additionally or alternatively, certain steps may be omitted, a pluralityof steps may be combined into one step to execute, and/or one step maybe divided into a plurality of steps to execute, etc.

The exemplary embodiments of the present disclosure further provide avisual apparatus for compensating sound information, applied to a touchterminal capable of presenting a graphical user interface, the graphicaluser interface at least partially including a game scene, and at leastpartially including a virtual object. As shown in FIG. 9, the visualapparatus for compensating sound information 100 may include a detectionand acquisition module 101, a providing module 102, and a first controlmodule 103.

The detection and acquisition module 101 may be configured to detect asound in a first preset range in the game scene, and acquire a type ofthe sound, and an orientation of a sound source of the sound relative tothe virtual object.

The providing module 102 may be configured to provide a visual controlon the graphical user interface, the visual control Including a virtualcomponent associated with the type of the sound.

The first control module 103 may be configured to control a pointingdirection of the virtual component according to the orientation of thesound source of the sound relative to the virtual object.

The visual apparatus may further include a second control module 104.The second control module 104 may be configured to acquire a distancebetween a sound source of the sound and the virtual object, and controla display form of the virtual component according to the distancebetween the sound source of the sound and the virtual object.

The specific details of various visual apparatus modules forcompensating sound information in the above have been described indetail in the corresponding visual methods for compensating soundinformation, and therefore will not be elaborated herein.

The exemplary embodiments of the present disclosure further provide avisual apparatus for compensating sound information, applied to a touchterminal capable of presenting a graphical user interface, the graphicaluser interface at least partially including a game scene, and at leastpartially including a virtual object. The apparatus may include: adetection and acquisition module, a providing module, and a firstcontrol module.

The detection and acquisition module may be configured to detect aplurality of sounds in a first preset range in the game scene, andacquire a type of each of the sounds, and an orientation of a soundsource of each of the sounds relative to the virtual object.

The providing module may be configured to provide a visual control onthe graphical user interface, the visual control including a virtualcomponent associated with a type of a first sound in the plurality ofsounds.

The first control module may be configured to control a pointingdirection of the virtual component according to the orientation of thesound source of the first sound relative to the virtual object.

The visual apparatus may further include a second control module. Thesecond control module may be configured to acquire a distance between asound source of the first sound, and the virtual object, and control adisplay form of the virtual component according to a distance betweenthe sound source of the first sound and the virtual object.

The specific details of various visual apparatus modules forcompensating sound information in the above have been described indetail in the corresponding visual methods for compensating soundinformation, and therefore will not be elaborated herein.

The exemplary embodiments of the present disclosure further provide avisual apparatus for compensating sound information, applied to a touchterminal capable of presenting a graphical user interface, the graphicaluser interface at least partially including a game scene, and at leastpartially including a virtual object. The apparatus may include: adetection and acquisition module, a providing module, and a firstcontrol module.

The detection acquisition module may be configured to detect a pluralityof sounds in a first preset range in the game scene, and acquire a typeof each of the sounds, and an orientation of a sound source of each ofthe sounds relative to the virtual object.

The providing module may be configured to provide a plurality of visualcontrols having a number same as that of the plurality of sounds on thegraphical user interface, wherein the plurality of visual controls arein one-to-one correspondence with the plurality of sounds, and each ofthe visual controls includes a virtual component associated with thecorresponding type of each of the sounds.

The first control module may be configured to control a pointingdirection of each of the virtual components according to the orientationof the sound source of a respective one of the sounds relative to thevirtual object.

The visual apparatus may further include a second control module. Thesecond control module may be configured to acquire a distance between asound source of a respective one of the sounds and the virtual object,and control a display form of each of the virtual components accordingto the distance between the sound source of a respective one of thesounds and the virtual object.

The specific details of various visual apparatus modules forcompensating sound information in the above have been described indetail in the corresponding visual methods for compensating soundinformation, and therefore will not be elaborated herein.

It should be noted that although a plurality of modules or units of thedevice for execution have been mentioned in the detailed descriptionabove, this division is not mandatory. In fact, according to theembodiments of the present disclosure, the features and functions of thetwo or more modules or units described above may be embodied in onemodule or unit. On the contrary, the features and functions of onemodule or unit described above may be further divided to be embodied bya plurality of modules or units.

The exemplary embodiments of the present disclosure further provide anelectronic device capable of implementing the above-mentioned method.

Those skilled in the art will appreciate that various aspects or tirepresent disclosure can be implemented as a system, method, or programproduct. Accordingly, various aspects of the present disclosure may beconcretely embodied in the following forms, i.e., a complete hardwareimplementation, a complete software implementation (including firmware,microcode, etc.), or a combination of hardware and softwareimplementations, which may be collectively referred to as “circuits”,“modules”, or “systems” herein.

An electronic device 600 according to such an embodiment of the presentdisclosure is described below with reference to FIG. 10. The electronicdevice 600 shown in FIG. 10 is merely an example and should not imposeany limitation on the function and scope of use of the embodiments ofthe present disclosure.

As shown in FIG. 10, the electronic device 600 is embodied in the formof a general purpose computing device. Components of the electronicdevice 600 may include, but are not limited to: at least one processingunit 610, at least one storage unit 620, a bus 630 connecting differentsystem components (including a storage unit 620 and a processing unit610), and a display unit 640.

The storage unit stores program codes which may be executed by theprocessing unit 610, such that the processing unit 610 executes varioussteps according to various exemplary embodiments of the presentdisclosure described in the “exemplary method” section of thedescription. For example, the processing unit 610 may execute the stepS1 of detecting a sound in a first preset range in the game scene, andacquiring a type of the sound, and a distance or an orientation of asound source of the sound relative to the virtual object; the step S2 ofproviding a visual control on the graphical user interface, the visualcontrol including a virtual component associated with the type of thesound; the step S3 of controlling a pointing direction of the virtualcomponent according to an orientation of the sound source of the soundrelative to the virtual object as shown in FIG. 1. For another example,the processing unit 610 may execute the step S10 of detecting aplurality of sounds in a first preset range in the game scene, andacquiring a type of each of the sounds, and a distance or an orientationof a sound source of each of the sounds relative to the virtual object;the step S20 of providing a visual control in an graphical userinterface, the visual control including a virtual component associatedwith a type of a first sound in the plurality of sounds; the step S30 ofcontrolling a pointing direction of the virtual component according toan orientation of the sound source of the first sound relative to thevirtual object as shown in FIG. 3. For another example, the processingunit 610 may execute the step S100 of detecting a plurality of sounds ina first preset range in the game scene, and acquiring a type of each ofthe sounds, and a distance or an orientation of a sound source of eachof the sounds relative to the virtual object; the step S200 of providinga plurality of visual controls having a number same as that of theplurality of sounds on the graphical user interface, wherein theplurality of visual controls are in one-to-one correspondence with theplurality of sounds, and each of the visual controls includes a virtualcomponent associated with the type of a respective one of the sounds;the step S300 of controlling a pointing direction of each of the virtualcomponents according to the orientation of the sound source of arespective one of the sounds relative to the virtual object as shown inFIG. 6.

The storage unit 620 may include a readable medium in the form of avolatile storage unit, such as a random access storage unit (RAM) 6201and/or a high speed cache storage unit 6202, and may further include aread only storage unit (ROM) 6203.

The storage unit 620 may also include a program/utility tool 6204 havinga set (at least one) of program modules 6205, such program modules 6205including but not limited to: an operating system, one or moreapplications, other program modules, and program data, each or a certaincombination of which may include an implementation of a networkenvironment.

The bus 630 may represent one or more of several types of busstructures, including a storage unit bus or a storage unit controller, aperipheral bus, a graphics acceleration port, a processing unit, or alocal bus using any of a variety of bus structures.

The electronic device 600 may also communicate with one or more externaldevices 700 (e.g., a keyboard, a pointing device, a Bluetooth device,etc.), and may also communicate with one or more devices that enable theuser to interact with the electronic device 600, and/or communicate withany device (e.g., a router, a modem, etc.) that enables the electronicdevice 600 to communicate with one or more other computing devices. Thiscommunication may be performed via an input/output (I/O) interface 650.Moreover, electronic device 600 may also communicate with one or morenetworks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN),and/or a public network, such as the Internet) through a network adapter660. As shown in the figure, the network adapter 660 communicates withother modules of the electronic device 600 via the bus 630. It should beunderstood that although not shown in the figure, other hardware and/orsoftware modules may be utilized in conjunction with the electronicdevice 600, including but not limited to: a microcode, a device driver;a redundant processing unit, an external disk drive array, a RAIDsystem, a tape driver, and a data backup storage system, etc.

Through the description of the above embodiments, those skilled in theart will readily understand that the example embodiments describedherein may be implemented by software or by software in combination withnecessary hardware. Therefore, the technical solutions according to theembodiments of the present disclosure may be embodied in the form of asoftware product which is stored in a not-volatile storage medium (aCD-ROM, a USB disk, a mobile hard disk, etc.) or a network, including anumber of instructions such that a computing device (which may be apersonal computer, a server, a terminal device, or a network device,etc.) performs the methods according to the embodiments of the presentdisclosure.

The embodiments of the present disclosure further provide a computerreadable storage medium storing a program product capable ofimplementing the above methods of the description thereon. In somepossible implementations, various aspects of the present disclosure mayalso be embodied in the form of a program product including a programcode for making the terminal device perform the steps according tovarious exemplary embodiments of the present disclosure described, inthe “exemplary method” section of the description when the programproduct is operated in the terminal device.

Referring to FIG. 11, a program product 800 for implementing the abovemethods according to the embodiments of die present disclosure, whichmay employ a portable compact disk read only memory (CD-ROM), includes aprogram code, and may be operated in a terminal device such as apersonal computer, is illustrated. However, the program product of thepresent disclosure is not limited thereto, and the readable storagemedium herein may be any tangible medium that contains or stores aprogram that may be used by or in connection with an instructionexecution system, apparatus, or device.

The program product may employ any combination of one or more readablemedia. The readable medium may be a readable signal medium or a readablestorage medium. The readable storage medium may be, for example, but isnot limited to, an electronic, magnetic, optical, electromagnetic,infrared, or semiconductor system, apparatus, or device, or anycombination of the above. More specific examples of the readable storagemedium (non-exhaustive list) include: an electrical connection with oneor more wires, a portable disk, a hard disk, a random access memory(RAM), a read only memory (ROM), an erasable programmable read onlymemory (EPROM or flash), an optical fiber, a portable compact disk readonly memory (CD-ROM), an optical memory device, a magnetic memorydevice, or any suitable combination of the above.

The computer readable signal medium may include a data signal that ispropagated in a baseband or as a part of a carrier, in which a readableprogram code is carried. Such propagated data signal may take a varietyof forms including, but not limited to, an electromagnetic signal, anoptical signal, or any suitable combination of the foregoing. Thereadable signal medium may also be any readable medium other than areadable storage medium, which may transmit, propagate or transport aprogram for use by or in connection with the instruction executionsystem, apparatus or device.

The program code included in the readable medium may be transmitted byany suitable medium, including but not limited to wireless, wire,optical cable, RF, etc., or any suitable combination of the above.

The program code for performing the operations of the present disclosuremay be written in any combination of one or more programming languages,including an object oriented programming language such as Java, C++,etc., and further including conventional procedural programming languagesuch as “C” language or a similar programming language. The program codecan be executed entirely on a user computing device, partially executedon a user device, as a stand-alone software package, partially executedon the user computing device and partially executed on a remotecomputing device, or entirely executed on the remote computing device ora server. In the case of involving in the remote computing device, theremote computing device can be connected to the user computing devicevia any kind of network, including a local area network (LAN) or a widearea network (WAN), or can be connected to an external computing device(e.g. connected via the Internet using an internet service provider).

The example embodiments may be embodied in many forms and should not beconstrued as being limited to the embodiments set forth herein; on thecontrary, these embodiments are provided so that the disclosure will becomprehensive and complete, and the concept of the example embodimentswill be comprehensively conveyed to those skilled in the art. The samereference numerals in the drawings denote the same or similar parts;therefore, the repeated description thereof will be omitted.

Furthermore, the described features, structures, or characteristics maybe combined in any suitable manner in one or more embodiments. In thefollowing description, numerous specific details are set forth, so as togive sufficient understanding on the embodiments of the disclosure.However, those skilled in the art will appreciate that the technicalsolution of the disclosure may be practiced without one or more of thespecific details, or other methods, constituent elements, materials,devices, steps, etc. may be employed. In other instances, well-knownstructures, methods, apparatuses, implementations, materials, oroperations are not illustrated or described in detail to avoid obscuringvarious aspects of the disclosure.

The block diagrams shown in the drawings are merely functional entitiesand do not necessarily have to correspond to physically separateentities. In other words, these functional entities may be implementedin software, or these functional entities or a part of the functionalentities is implemented in one or more software-hardened modules, orthese functional entities are implemented in different network and/orprocessor apparatuses and/or microcontroller apparatuses.

Moreover, the above-described drawings are merely illustrative of theprocesses included in the methods according to the exemplary embodimentsof the present disclosure, and are not intended to be limiting. It willreadily understand that the processes shown in the above drawings do notindicate or limit the chronological order of these processes. Inaddition, it will also readily understand that these processes may beperformed synchronously or asynchronously, for example, in a pluralityof modules.

Other embodiments of the present disclosure will be apparent to thoseskilled In the art after taking the description into consideration andpracticing the disclosure disclosed herein. This application is intendedto cover any variations, uses, or adaptations of the disclosurefollowing the general principles thereof and including such departuresfrom the present disclosure as come within known or customary practicein the art. The description and embodiments are to be regarded asillustrative only, and the real scope and spirit of the presentdisclosure are pointed out in the claims.

It will be appreciated that the present disclosure is not limited to theexact construction that has been described above and illustrated in theaccompanying drawings, and that various modifications and changes can bemade without departing from the scope thereof. The scope of the presentdisclosure is limited by the appended claims only.

What is claimed is:
 1. A visual method for compensating soundinformation, applied to a touch terminal capable of presenting agraphical user interface, the graphical user interface at leastpartially comprising a game scene, and at least part of a virtualobject, wherein the method comprises: detecting a sound in a firstpreset range of the game scene, and acquiring a type of the sound, andan orientation of a sound source of the sound relative to the virtualobject; providing a visual control on the graphical user interface, thevisual control comprising a virtual component associated with the typeof the sound; and controlling a pointing direction of the virtualcomponent according to the orientation of the sound source of the soundrelative to the virtual object.
 2. The visual method for compensatingsound information according to claim 1, wherein the method furthercomprises: acquiring a distance between the sound source of the soundand the virtual object; and controlling a display form of the virtualcomponent according to the distance between the sound source of thesound and the virtual object.
 3. The visual method for compensatingsound information according to claim 1, wherein before the step ofproviding the visual control on the graphical user interface, the methodfurther comprises: determining the sound source of the sound is locatedwithin a second preset range and out of a third preset range.
 4. Thevisual method for compensating sound information according to claim 1,wherein the virtual component comprises an ideographic image and adirection identifier, the ideographic image is corresponding to the typeof the sound, and a pointing direction of the direction identifier iscorresponding to the orientation of the sound source of the soundrelative to the virtual object.
 5. The visual method for compensatingsound information according to claim 2, wherein the controlling thedisplay form of the virtual component according to the distance betweenthe sound source of the sound and the virtual object comprises:controlling a display form of at least one of a transparency, a size,and a brightness of the virtual component according to the distancebetween the sound source of the sound and the virtual object.
 6. Avisual method for compensating sound information, applied to a touchterminal capable of presenting a graphical user interface, the graphicaluser interface at least partially comprising a game scene, and at leastpart of a virtual object, wherein the method comprises: detecting aplurality of sounds in a first preset range of the game scene, andacquiring a type of each of the sounds, and an orientation of a soundsource of each of the sounds relative to the virtual object; providing avisual control on the graphical user interface, the visual controlcomprising a virtual component associated with a type of a first soundin the plurality of sounds; and controlling a pointing direction of thevirtual component according to the orientation of the sound source ofthe first sound relative to the virtual object.
 7. The visual method forcompensating sound information according to claim 6, wherein the virtualcomponent comprises an ideographic image and a plurality of directionalidentifiers, the number of the directional identifiers is the same asthe sounds, the ideographic image is corresponding to the type of thefirst sound, and the plurality of direction identifiers are provided inone-to-one correspondence with the plurality of sounds; and the step ofcontrolling the pointing direction of the virtual component according tothe orientation of the sound source of the first sound relative to thevirtual object comprises: controlling a pointing direction of each ofthe direction identifiers according to the orientation of the soundsource of a respective one of the sounds relative to the virtual object.8. The visual method for compensating sound information according toclaim 6, wherein the method further comprises: acquiring a distancebetween the sound source of the first sound and the virtual object; andcontrolling a display form of the virtual component according to thedistance between the sound source of the first sound and the virtualobject.
 9. A visual method for compensating sound information, appliedto a touch terminal capable of presenting a graphical user interface,the graphical user interface at least partially comprising a game scene,and at least part of a virtual object, wherein the method comprises:detecting a plurality of sounds in a first preset range of the gamescene, and acquiring a type of each sound, and an orientation of a soundsource of each of the sounds relative to the virtual object, providing aplurality of visual controls on the graphical user interface, the numberof the visual controls being the same as the sounds, wherein theplurality of visual controls are provided in one-to-one correspondencewith the plurality of sounds, and each of the visual controls comprisesa virtual component associated with the type of a respective one of thesounds; and controlling a pointing direction of each of the virtualcomponents according to the orientation of the sound source of arespective one of the sounds relative to the virtual object.
 10. Thevisual method for compensating sound information according to claim 9,wherein the method further comprises: acquiring a distance between asound source of a respective one of the sounds and the virtual object;and controlling a display form of each of the virtual componentsaccording to the distance between the sound source of a respective oneof the sounds and the virtual object.
 11. A computer readable storagemedium storing a computer program thereon, wherein the computer programis executed by a processor to implement the visual method forcompensating sound information according to claim
 1. 12. A computerreadable storage medium storing a computer program thereon, wherein thecomputer program is executed by a processor to implement the visualmethod for compensating sound information according to claim
 6. 13. Acomputer readable storage medium storing a computer program thereon,wherein the computer program is executed by a processor to implement thevisual method for compensating sound information according to claim 9.14. An electronic device, comprising: a processor; and a memory forstoring executable Instructions of the processor; wherein the processoris configured to execute the visual method for compensating soundinformation according to claim 1 via executing the executableinstructions.
 15. The electronic device according to claim 14, whereinthe processor is further configured to: acquire a distance between thesound source of the sound and the virtual object, and control a displayform of the virtual component according to the distance between thesound source of the sound and the virtual object.
 16. The electronicdevice according to claim 14, wherein the processor is furtherconfigured to: before the step of providing the visual control on thegraphical user interface, determine the sound source of the sound islocated within a second preset range and out of a third preset range.17. The electronic device according to claim 14, wherein the virtualcomponent comprises an ideographic image and a direction identifier; theideographic image is corresponding to the type of the sound, and apointing direction of the direction identifier is corresponding to theorientation of the sound source of the sound relative to the virtualobject.
 18. The electronic device according to claim 14, wherein theprocessor is further configured to: control a display form of at leastone of a transparency, a size or a brightness of the virtual componentaccording to the distance between the sound source of the sound and thevirtual object.
 19. An electronic device, comprising: a processor; and amemory for storing executable instructions of the processor; wherein,the processor is configured to execute the visual method forcompensating sound information according to claim 6 via executing theexecutable instructions.
 20. The electronic device according to claim19, wherein the virtual component comprises an ideographic image and aplurality of directional identifiers, the number of the directionalidentifiers is the same as the sounds, the ideographic image is thecorresponding to the type of the first sound, and the plurality ofdirection identifiers are provided in one-to-one correspondence with theplurality of sounds; and the processor is further configured to:controlling a pointing direction of each of the direction identifiersaccording to the orientation of the sound source of a respective one ofthe sounds relative to the virtual object.
 21. The electronic deviceaccording to claim 19, wherein the processor is further configured to:acquire a distance between the sound source of the first sound and thevirtual object; and control a display form of the virtual componentaccording to the distance between the sound source of the first soundand the virtual object.
 22. An electronic device, comprising: aprocessor; and a memory for storing executable instructions of theprocessor; wherein, the processor is configured to execute the visualmethod for compensating sound information according to claim 9 viaexecuting the executable instructions.
 23. The electronic deviceaccording to claim 22, wherein the processor is further configured to:acquire a distance between a sound source of a respective one of thesounds and the virtual object, and control a display form of each of thevirtual components according to the distance between the sound source ofa respective one of the sounds and the virtual object.